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Abstract 



We investigate the structure of Parisi measures, the functional order parame- 
ters of mixed p-spin models in mean field spin glasses. In the absence of external 
field, we prove that a Parisi measure satisfies the following properties. First, at all 
temperatures, the support of any Parisi measure contains the origin. If it contains 
an open interval, then the measure has a smooth density on this interval. Next, 
we give a criterion on temperature parameters for which a Parisi measure is nei- 
ther Replica Symmetric nor One Replica Symmetry Breaking. Finally, we show 
that in the Sherrington-Kirkpatrick model, slightly above the critical temperature, 
the largest number in the support of a Parisi measure is a jump discontinuity. An 
analogue of these results is discussed in the spherical mixed p-spin models. As a 
tool to establish these facts and of independent interest, we study functionals of the 
associated Parisi PDEs and derive regularity properties of their solutions. 

1 Introduction and main results 

The mixed p-spin model is one of the most fundamental mean field spin glasses. The 
study of this model has provided a rich collection of problems and phenomena both in 
the physical and mathematical sciences. The reader interested in the background, history 
and methodologies is invited to check the books of Mezard-Parisi-Virasoro ^ , Talagrand 
p!9j and the numerous references therein. 

In this paper we are interested in the structure of the functional order parameter of 
this model in the absence of external field. This order parameter, also known as the Parisi 
measure, is predicted to fully qualitatively describe the system and has been the main 
subject of study by several authors both in physics and mathematics [ZIIIZ!- Although the 
role of the order parameter has been partially unveiled and significant progress has been 
made in the recent years, the structure of the Parisi measures remains very mysterious at 
low temperature. 

* auffing@math.uchicago.edu 
^ wkchen@math . uchicago . edu 
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Let us now describe the mixed p-spin model. For iV > 1, let S^v := { — 1, +1}^ be the 
Ising spin configuration space. Consider the pure p-spin Hamiltonian with p > 2, 

1 ^ 

Hn,p{(t) = ^(p_i)/2 9h,...,ip(^h ■ ■ ■ (^ip (1) 

ii,...,ip=l 

for cr = (cTi, . . . , ajy) G Sjv, where the random variables gij^^...,ip are independent standard 
Gaussian for all p > 2 and {ii, . . . ,ip). The mixed p-spin model is defined on S^r and its 
Hamiltonian is given by a linear combination of the pure p-spin Hamiltonians, 

oo 

Hm{(t) = J2PpH^,p{ct). (2) 

p=2 

Here the sequence f3 := (/3p)p>2 is called the temperature parameters and satisfies J2'^=2 '^^Pp < 
oo that is enough to guarantee the well-definedness of the model. It is easy to compute 
that the covariance of if at is given by 

¥.HM{fT)HM{fT') = N^Ria^a')), 

where 

N 

N 



is the overlap between spin configurations cr and cr' and 

oo 

an) ■.= J2f3y. 

p=2 

When ^{u) = /3|m^, we recover the famous Sherrigton-Kirkpatrick model [H]. The Gibbs 
measure is defined as 

expgjv(o-) w ^ ^ 

where the normalizing factor Zn is known as the partition function. The central goal and 
most important problem in this model is to understand the large behavior of these 
measures at different values of f3. This is intimately related to the computation of the 
free energy A^~^logZjv in the thermodynamic limit and, as a result, has been studied 
extensively since the ground-breaking work of G. Parisi p!2l [13] . 

In the Parisi solution, it was predicted that the thermodynamic limit of the free energy 
can be computed by a variational formula. More precisely, consider the Parisi functional 
V (see ([9])) defined on the space Md[0, 1] of all probability measures on [0, 1] consisting of 
a finite number of atoms. Then the following limit exists almost surely, 

lim ^logZjv = inf V{fi). (3) 
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For the detailed mathematical proof of this result, the readers are referred to |9l [16]. It 
is known ^ that the Parisi functional can be extended continuously to the space M[0, 1] 
of all probability measures on [0, 1] with respect to the metric d{fi, := \^{[0,u\) — 
fi'{[0,u])\du. This guarantees that the infinite dimensional variational problem on the 
left side of ([s]) always has a minimizer. Throughout the paper, we will call any such 
minimizer a Parisi measure and denote it by /xp. It is expected that for any mixed p-spin 
model, the Parisi measure is unique and it gives the limit law of the overlap -R(cr^,cr^) 
under KG%^. Ultimately, it fully describes the limit of replicas (cr^)^>i with respect to the 
measure KG%°° . Under certain assumptions on the temperature parameters, these have 
been rigorous verified in recent years, see [10] for an overview along this direction, but 
the general case remains open. 

The main objective of this paper is to establish some qualitative properties about Parisi 
measures that have been predicted in physics literature. We now summarize these pre- 
dictions. Denote by supp fip the support of fip and by qm the largest number in supp fj,p. 
We say that a Parisi measure is Replica Symmetric (RS) if it is a Dirac measure; One 
Replica Symmetric Breaking (IRSB) if it consists of two atoms; Full Replica Symmetric 
Breaking (FRSB) if it contains a continuous component on some interval contained in its 
support. For the Sherrington-Kirkpatrick model (^(m) = with no external field, if 

< /32 < the model is RS: fip = 6o. (This region of temperature, known as the high 

temperature region, is different from the familiar one /32 < 1 in the original SK model [H] , 
because our Hamiltonian sums over all 1 < ^l,^2 < N). In the low temperature regime, 

> 1/v^, the model exhibits FRSB behavior: /ip = + (1 — m)5gj^j. Here z/ is a fully 
supported measure on [0,gM] with m := i/([0,gM]) < 1 and possesses a smooth density. 
For detailed discussion, the readers are referred to Chapter III in [7]. 




Figure 1: Schematic forms of the order parameter x{q) = A''p([0,g]) for the Sherrington- 
Kirkpatrick model at zero magnetic field [7| Page 41]. The left picture is the order 
parameter in RS phase, while the right is in FRSB phase. 

In the case of pure p-spin model with p > 3 {^{u) = f^pU^), it is conjectured in the work 
of Gardner [3] that the model in the absence of external field goes through two phase- 
transitions described by two critical temperatures f3p^ci and (3p^c2 ■ First at high temperature 
(3p < /3p,ci, the model is RS: /ip = 6o. In the low temperature region f3p^ci < < (3p,c2, the 
model is IRSB: /ip = m^o + (1 ~ ^)^qM for < m < 1. Last, at very low temperature 
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/3p > /3p,c2! the Parisi measure is FRSB: /ip = m6o + z/ + (1 — m')5q^j, where z/ is a fully 
supported measure on [g, qu] for some g > with m' := gjv/]) + ^ and has a smooth 
density. 




Figure 2: Schematic forms of the order parameter x{q) = /ip([0,g]) for the pure p-spin 
model with p > 3 at zero magnetic field j5]. The pictures from left to right are order 
parameter in RS phase, IRSB phase and FRSB phase, respectively. 

To the best of our knowledge, the preceding discussions are by far the most well- 
known predictions about the structures of Parisi measures studied in physics literature. 
For mixed models, the behavior may be slightly different as one may expect more phase 
transitions. Examples of different structures of Parisi measures were also obtained in the 
spherical models [HI |T3] . To sum up what we have already discussed up to now, all these 
models in the absence of external field share three general phenomena: 

(PI) The origin is contained in the support of the Parisi measure at any temperature. 
(P2) One expects FRSB behavior at low temperature. 

(P3) Any Parisi measure has a jump discontinuity at qm at any temperature. 

Our main results about these predictions are stated as follows. The first one establishes 
(PI) and provides a condition on ^ that determines when is an isolated point of the 
support. 

Theorem 1. Let hp he a Parisi measure. Then we have that 
{i) G swpp Hp. 

(ii) lf^"{0) < 1, then fip{[0,q)) = fip{{0}), where q G [0,1] satisfies ^"(g) = 1. 

The next two theorems go in the direction of (P2). We start by establishing two results 
on the regularity of a Parisi measure. The first one shows that a Parisi measure cannot 
have a jump at point of accumulation from both sides of the support. The second states 
that if a Parisi measure is not purely atomic then it must have a smooth density. 

Theorem 2. Let hp be a Parisi measure. 
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(i) Suppose that there exist an increasing sequence {uj)i>i and a decreasing sequence 
{u'^)e>i of supp fip such that lim^_5.oo uj = uo = lim£_5.oo Then fip is continuous 
at uq. 

{ii) If (a, b) C supp fip for some < a < b < 1, then the distribution function of fip is 
infinitely differentiable on [a, 6). 

Recall that we say a Parisi measure is RS if it is a Diract measure and is IRSB 
if it consists of two atoms. In what follows, we show that a Parisi measure has more 
complicated structure at very low temperature. 

Theorem 3. Suppose that ^ satisfies 

e(l) > max (^8 log 2, ^v^S^t''') • (4) 

Then the Parisi measure fip is neither RS nor IRSB. 

In other words, the criterion ^ ensures that the support of a Parisi measure contains 
at least three points. This is the first result that provides a partial evidence toward the 
conjecture (-P2). Below we list two examples, the pure p-spin model and the (2 + p)-spin 
model, for which the condition Q can be easily simplified. 

Example 1 (pure p-spin model). Recall the pure p-spin has ^{u) = P^u^. Condition Q 
on ^ is equivalent to /3p > max(2A/2 log 2, 2P"'"^^/3). 

Example 2 ((2 +p)-spin model). The Hamiltonian of the (2 +p)-spin model is governed 
by ^(n) = Plu^ + Plu^ for p > 3. If /^a and (5^ satisfy 

e(l) > ^p22^+^° (5) 

then this model is neither RS nor IRSB. Indeed, if (32 and (3p satisfy ([s]), it implies 
^(1) > 81og2. On the other hand, since ^'(1)/^(1) = (2/3| + p/32)/(/32 + /js^ < this and 
(|5| imply 

e(l) > ^VPe(l)2^^' > ^v^2W+l 

Therefore, Q is satisfied. 

As we have mentioned before, in the case of the SK model, the Parisi measure is RS 
in the high temperature regime (32 < 1/^2. This was proved by Aizenman, Lebowitz and 
Ruelle in [1]. Later it is also understood by Toninelli in [20] that a Parisi measure is not 
RS in the low temperature region /32 > I/V2. Note that, as we discussed before, as long 
as (32 is above the critical temperature 1/a/2, the SK model is conjectured to be FRSB. 
In the following, we prove that (-P3) holds if the SK temperature (32 is slight above the 
critical temperature 1 / \/2 and the total effect of the rest of the mixed p-spin interactions 
with p > 3 is sufficiently small. 
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Theorem 4. Suppose that ^ satisfies l/-\/2 < (^2 < 3/2\/2 and 

^ + ^vW)<l. (6) 
Then the Parisi measure fip has a jump discontinuity at qm- 

The fact that a qm is a jump discontinuity of the Parisi measure was one of the main 
assumptions in Theorem 15.4.4 in [19] to prove a decomposition of the system in pure 
states. The theorem above provides the first non-trivial example where this hypothesis is 
satisfied. 

Example 3 (the SK model). Consider the SK model ^(m) = A direct computation 
yields that ^"(1) = 2/3| and ^'"(1) = 0. If 1/^2 < P2 < 3/2^2, then (g is satisfied and 
thus qu is a jump discontinuity of the Parisi measure. 

The rest of the paper is organized as follows. In the next section, we introduce the 
Parisi PDE and investigate its regularity. We then study the behavior of the Parisi 
functional near Parisi measures in Section HI The results therein are the main tools used 
in Section |4] where we prove Theorems 1, 2, 3 and 4. In Section [5] we discuss analogues 
of our results in the spherical p-spin model. We end the paper with an Appendix that 
discuss uniform convergence of derivatives of solutions of the Parisi PDE. 



2 The Parisi PDE and its properties 

We now define the Parisi functional and PDE. As in the previous section, we denote by 
M(^[0, 1] the collection of all probability measures on [0, 1] consisting of a finite number of 
atoms and by M[0, 1] the collection of all probability measure on [0, 1]. Each G M^^, 1] 
uniquely corresponds to a triplet (/c, m, q) in such a way that /i([0, g^]) = nip for < p < 
A; + 1, where A; > 0, m = (mp)o<p<fe+i and q = (gp)o<p<fc+2 satisfy 

mo = < mi < m2 < • ■ ■ < mfc < m^+i = 1, 

go = < gi < g2 < ■ • ■ < gfc+i < qk+2 = l- 

The Parisi functional V is introduced as follows. Consider independent centered Gaus- 
sian random variables (-Zj)o<j<fc+i with variances Kz^ = ^'(gp+i) — ^'(gp)- Starting from 

fe+i 

Xk+2 = log cosh ^ Zp, 

p=0 

we define recursively for < p < A; + 1, 

Xp = — log Ep exp nipXp+i , (8) 

TUp 

where Ep denotes expectation in the random variables {zj)j>p. When nip = 0, this means 
Xp = EpXp_|_i. The Parisi functional for /i is defined as 

V{fi) =Xo-^ r<(n)/i([0,M])rfn. (9) 
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One may alternatively represent this functional by using the Parisi PDE. Let be 
the solution to the following nonlinear antiparabolic PDE, 

du^^{x,u) = {^l^^{x,u)+^l{[{),u]) {d,,^^{x,u)f) , (a;,M) G M X [0,1] (10) 

with end condition $^(x, 1) = log cosh x. Since the distribution function of yU is a step 
function, such equation can be explicitly solved by using the Cole-Hopf transformation. 
Indeed, for g^+i < m < 1, 

$^(x, u) = log cosh X + ^(^(1) - i\u)) (11) 

and one can solve the equation decreasingly to get that for qp < u < qp^i with < p < k, 

1 



nip 



<l>^(x,u) = — logEexpmp<l>^(x + 2;Wf (gp+i) - f (u),gp+i) (12) 



where z is a standard Gaussian random variable. Now $^ and (Xp)o<p<fc+2 are related 
through $^((^pZ,o V' = for 1 < p < /c + 2 and $^(0,0) = Xq. It is well-known 
[6] that /i t-)- $^ defines a Lipschitz functional from (Mrf[0, V\,d) to (C(]R x [0, 1]), || ■ ||oo)- 
We can then extend this mapping continuously on (M[0, 1], d) and will call $^ the Parisi 
PDE solution associated to /i for any /i G M[0, 1]. Consequently, this induces a continuous 
extension of the Parisi functional (|9| to the space (M[0, 1], rf). 

Let us proceed to state our main results on some basic properties of the Parisi PDE 
solutions. Let B = {B{t))t>i be a standard Brownain motion and consider the time 
changed Brownian motion M{u) = B{^'{u)) for < n < 1. For any G M[0, 1], we define 

W,iu)= / ($^(M(M),n)-<l>^(M(t),t))d/i(t), MG[0,1]. (13) 

The following two propositions will play an essential role throughout the paper. The first 
one concerns with the regularity and the uniform convergence of the solutions. 

Proposition 1. Let fi G M[0, 1]. Suppose that {fin)n>i C M[0, 1] converges to /i. 

(i) For j > 0, dl^^ exists and is continuous. Uniformly on M x [0, 1], 

lim di^,„ = di^,. 

n— >-oo 

(ii) Let P be a polynomial on W for some j > 1. Then 

u ^ EP(a,$^(M(M), m), . . . , di^^{M{u),u)) exp W^{u), u G [0, 1]. 
is a continuous function and uniformly on [0, 1], 

lim EP(9.$p„(M(n), n), . . . , a^$,„(M(n), «)) exp W,Su) 

n— ^oo 

= EP(a,$^(M(M), n), . . . , di^^{M{u),u)) exp W,{u). 
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{Hi) If fi is continuous on [0, 1], dudi^^^ is continuous for all j > 0. 



Since the proof of this proposition requires some tedious and technical computations 
and estimates, we will defer it to the Appendix. Now, we address the behavior of the first 
and second partial derivatives of the solution with respect to the x variable as well as a 
property about W^. 



Proposition 2. Let /i G M[0, 1]. We have that for all {x,u) G M x [0, 1], 



-dx^i,{x,u) 



\dx<^f,{x,u)\ < 1 
C 



cosh X 



< d^^„(x,u) < 1, 



where C > is a constant depending only on ^. 



(14) 
(15) 

(16) 

(17) 



Proof. For /i G Md[0, 1], the assertions (14), (15) and (16) are exactly in Lemma 14.7.16 



|19j . while (17) is valid from (14.23) in [19]. For general G M[0, 1], an approximation 
argument and (i) in Proposition [l] conclude the proof. 



3 The Parisi functional near Parisi measures 

Our main approach for understanding Parisi measures is to investigate the Parisi func- 
tional around these minimizers. To attain this purpose, we define for any fi G M[0, 1], 

T^{u)=E{dx^^{Miu),u)YexpW^iu), mG [0,1]. (18) 

Suppose that a is a continuous function on [0, 1] satisfying < m + a{u) < 1 for m G [0, 1] 
and \a{u) — a{u')\ < \u — u'\ for u,u' G [0,1]. For t G [0,1], let /ij be the probability 
measure induced by the mapping u i— )■ u + ta{u), that is, fit{[0,u + ta{u)]) = fi{[0,u]) 
for u G [0, 1]. It is well-known from Lemma 3.7 [17] that a nontrivial application of the 
Gaussian integration by parts gives 



d 



t=o 



e'iu)iu~T^iu))a{u)dfxiu), (19) 



where the left side of (19) is the right derivative. Our main results regarding some basic 
properties of are summarized below. 

Proposition 3. F^ is difjerentiable and F'^ is continuous with 

r;(n) = e{umdl^,iM{u),u)YexpW,{u). (20) 

We have 

T'(u + h)-T'(u) 
lim 1 ^ =7i,,(^) -/i([0,«])72,,(t.) (21) 

/I— >0+ 11 
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and 



lim 



T'(u + h) 



h 



7i,/.(m) -/i([0,M))72,^(M) 



(22) 



where 



7i,A^) = r(«)E(a^$;.(M(u),M))^expiy^^n) 
+ r («)'E(a^$^(M(M), n))2 exp iy^(n 



72,m(«) = 2CiufE{dl<!>^iMiu),u)fexpW^iu). 
The proof of this proposition will be postponed to the end of this section. In the case 



that /i is a Parisi measure, the left side of (19) is nonnegative. This fact combined with 



Proposition [3] allows us to derive further properties on the first and second derivatives of 
that are stated in the following theorem. 



Theorem 5. Let fip be a Parisi measure. Then F^^l 
u G supp fip. 



u 



u and V, 



.u 



< 1 for all 



[u) = u ioT u E supp fip has firstly appeared in [T71 Proposition 
3.2]. It can be simply argued as follows. Observe that since /ip minimizes the Parisi 



Proof. The assertion F 



functional, (19) gives 



^"(m) (u - T^p{u)) a{u)dfip{u) 



dt 



> 



(23) 



i=0 



for arbitrary choice of a satisfying < u+a{u) < 1 for u G [0, 1] and \a{u)—a{u')\ < \u—u'\ 
for u,u' G [0,1], where fip^t is induced by the mapping u u + a{u)t and /ip. This 



amounts to say that P 



u whenever u G supp yUp satisfies i"{u) > 0. If there is 



some u G supp /ip such that ^"{u 
since dr^ 



-^p is odd in u from (14), we have Tfj,p{0) 
first assertion. 



0, then the only possibility is m = and in this case, 
0. This completes our proof for the 



Next, let us prove the second statement. Let Uq G supp /ip. If there exists a sequence 
{u£}£>i of supp fip such that lim^_^oo'W^ = Uq, then the first assertion, the differentiability 
of Tfj_p and the continuity of P' yield T' (uq) = 1. Now assume that uq is an isolated 



point. If ^"(uo) = 0, then we are clearly done by (20). Suppose that ^"(mq) > 0. Note 



that (15), (16) and (17) applied to fi = fip imply uq < 1. 

Let 5 G (0, 1 — Uq) and define as{u) = max(5 — \u — uq\,0) on [0,1]. Then as is a 
continuous function that satisfies < u + as{u) < 1 for all u G [0, 1] and \as{u) — as{u')\ < 



\u — u 



for M, u' G [0, 1]. Applying the mean value theorem to u 



P/.p(m) 



we obtain 



u 



< max 



{I - V {u))5, u e[uo,uo + 5]. 



(24) 
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Hence, since uq is isolated, for 5 be sufficiently small we have 

^"{u){u — Tp{u))as{u)dfi{u) = / ^"{u){u — Tp{u))as{u)dfi{u) 

UQ+5 



PUQ+O 



uo 

max (l-T'^^{u'))6'e{uo)fi{{uo}). 

u'G[uo,uo+d\ 



From (23), this inequality implies 

max (i-r;^K))>o 

for sufficiently small S. Therefore, by continuity of T^^, we obtain r'^^{uo) < 1 and this 
completes our proof. 

□ 

The rest of the section is devoted to proving Proposition |3| We rely on two lemmas. 

Lemma 1. Suppose that fi is a probability measure on [0, 1] with continuous density 
p{t),t e [0, 1]. Consider f E C^''^{R x [0, 1]) and g E C{R x [0, 1]) such that on M x [0, 1] 

max{|/(x,u)|, \d^f{x,u)\, |(9„/(x,u)|, \dlf{x,u)\} < Cexp (25) 
0<g{x,u)<C{l + \x\+u) (26) 

for some fixed constant C > 0. Define 

F{u) = Ef{M{u),u) expD{u) (27) 

for u E [0,1], where D{u) := — g{M{t),t)p(t)dt. Then we have that 

F\u) = E {dJ{M{u),u) + ^^dlf{M{u),u)^ expD(M) ^^^^ 
- p{u)Eg{M{u), u)f{M{u),u) expD{u). 



Proof. We will only prove that the right derivative of F is equal to (27). One may adapt 
the same argument to prove that the left derivative of F is also equal to (27). Suppose 
that < M < 1. Let < /i< 1 - M. Write 

F{u + h)-F{u)=EIi{u)+El2iu), (29) 

where 

h{h) := {f{M{u + h),u + h)- f{M{u),u)) exp D{u), 
hih) := f{M{u + h),u + h){expD{u + h)-expD{u)). 
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It suffices to check that 

HO h 

lim — ; : 

hiO h 



E (^dtf{M{u),u) + ^dlf{M{u),u)^ expD{u), 
-p{u)Ef{M{u),u)g{M{u),u) expD{u). 



(30) 
(31) 



Let us handle (30) first. Using Ito's formula, we write 



/(M(m + h),u + h)- f{M{u),u) 



u+h 



J{t)dt 



u+h 



dJ{M{t),t)dM{t), 



where 



Jit) := dJ{M{t),t) + -dlf{M{t),t)C{t). 



Note that since D{u) is independent of (M(t) — M{u))u<t<u+h^ a standard approximation 
argument using the left Riemann sum for £^ d^f{M{t),t)dM{t) and ^ yield that 
E dJ{M{t),t)dM{t)e-xY>D{u) = and thus 

"U+h 

J{t)dtexp D{u). 



Define 



yEUh) = yE 
h h 



Eo{h) = sup — 

o<h'<h n- Ju 



(32) 



\J{t)\dtexY>D{u) 



Using D < 0, (25), (26) and the fact that 



it follows that 



( sup \M{h)\ >h)< 4P(M(1) > 6), h> 0, 

0</i<l 



E£'o(/i) < C(l + ^"(l))Eexp sup \M{u + h') 

0<h'<h 

< C(l + r(l))Eexp sup \M{h')\ 

0<h'<l 

< 4C(1 + ^"(l))EexpM(l) 
e'(l) 



(33) 



(34) 



4C(l + r(l))exp 



Since 



lim — 

hio h 



u+h 



J{t)dt = J{u), 

using ( 34 ) and the dominated convergence theorem yield 

r-u+h 

hm -E / Jit)dt expD(u) = EJ(u) exp D(u) 
hio h 
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and this combined with (32) gives (30) 



Next we compute (31). Define 



Ei(h)= max \f(M(u + h'),u + h') 

0<h'<h 



E2(h) = max 

0<h'<h 



expD{u + h') — expD{u) 
h' 



From (25) and (33) 



EEi{hy < C^Eexp2 max \M{u)\ < 4(:72Eexp2M(l) < 4^^ exp 2^'(1). (35) 

0<u<l 



Using D <0 and (26) again, the mean value theorem imphes 

\D{u + h) - D{u)\ 



E2{h) < sup 

0<h'<h 

< C sup 

0</i'</i 



h' 



j:^^\i+\M{t)\+t)p{t)dt 



h' 



< 2C||p||oo + C||p||oo sup \M{u)\ 

0<u<l 

and thus, the use of (a + 6)^ < 4a^ + 46^ for a, 6 G M leads to 

EE2{hf <C\l6\\p\\l, + 4\\p\\l,E sup \M{u) 

0<u<l 

= c'mp\L + M\p\\U'a))- 



(36) 



From the Cauchy-Schwartz inequality, (35) and (36), we conclude that EEi{h)E2{h) < oo. 
Since supq<;j/<^ \l2{h')\/h' < Ei{h)E2{h) and 



hiO h 



-p{u)f{M{u),u)g{M{u),u) exp D{u) 



the dominated convergence theorem implies (31) and this completes our proof 



In the next Lemma we use the convention that for any sequence (aj)j>i, Y^j=i % = 0- 

Lemma 2. Let p G ^[0, 1] he continuous on [a, 6] for some a,b ^ [0, 1]. Suppose that L 
is a polynomial on M.^ . Define 



for u G [0, 1]. Then for u G [a, 6], 



(37) 



k i—1 / .\ 

-M[0,«]) J] J] (M9,X(5.$,,...,9,^$,)9^^^ ) expW^, 

1=1 j=i V-^/ 



(38) 
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Proof. To simplify of our notation, we denote dy.L by Li and dy.dy^L by Lij. Also, we 
denote by $, 9^$/^ by ^^.j and d^du^^j. by ^^.j^j provided the derivatives exist. First 
we prove (38) in the case that has a continuous density p on [0,1]. This assumption 
implies that ^x^u is continuous from [iii) in Proposition [T| Set 

= L($^(x,u),...,$a;"(a;,M))expS'(a;,M), 

where S{x,u) := p(t)dt^{x,u). Using Proposition [l| we compute that 

Li^x^u + Lp^ + L J pdt^uj exp S, 

Li^x^+i + L J pdt^xj exp S, 

(n n \ 

V Lij^x^+i^x^+^ + V i^i^x'+a + / pc/t^^a exp S 
i,j = l i=l Jo J 

+ J pdti2J2L^^x^+'^x + L J pdt{<!>xfjexpS. 



i=l 

Recall that $ satisfies the Parisi PDE 



Taking i-th partial derivative with respect to the x variable yields 



i-j+i 



j=Q 



Therefore, we have that 

duf + ^^dlf - pgf 



pdt + — (^$^2 + J pdt{<^>xYj J exp ^ + ^ Li$^,„ exp S 
+ y XI Ui^x-+^^x^+^ + Yl Li^x'+^ + 2 / pdtY^ Li^x^+i^x exp S 

\i,j=l i=l i=l / 

= -y ^ L J $^»+2 + ^ prft ^ (^^.^ j exp S 



i=l \ j=0 



+ y 5Z + X] + 2 / ^^'^o^^+i^a- I exp S 

\i,j=l i=l i=l J 



Y2 Lij^x'+^^x:i+^ - J pdt^^Y^ (^jj Li^x:i+^^x'-:i+^ j exp S" . 



J,// / lb nil 11' Ir i- X -N 

2 



KiJ=l "'^ i=l 3=1 
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Applying Lemma [T], our assertion clearly follows in this case that fi has continuous density 
on [a, b]. Next, we assume that fi is continuous on [0, 1]. Pick a sequence of probability mea- 
sures (/i„)„>i on [0, 1] with continuous densities that converges to weakly. Using the con- 
tinuity of /i on [a, b], we can further assume that lim„_>oo sup„<^<^ |/^n([0, u]) — fi{[0,u])\ = 



0. Let F^^, F^25 ■ ■ ■ iPfj. be defined as (37) by using /xi, /i2, • • • , respectively. Using the 
weak convergence of (/in)n>i and Proposition [l| we know that (-F^„)n>i converges to 
uniformly on [0, 1]. On the other hand, by our special choice of (/in)n>i and Theorem [T| 
{F'^^)n>i converges uniformly on [a, b]. These facts imply that on [a, 6], is differentiable 



and F'^ is given by ( 38 ) . This completes our proof. 



Proof of Proposition\^ Let us pick a sequence of probability measures (/U„)„>i with con- 
tinuous densities that satisfies lim„_j.oo /in([0, w]) = fi{[0,u]) for all < -u < 1. An applica- 
tion of Lemma [2] with k = 1 and L{yi) = y\ yields that 



Another application of Lemma |2] with k = 2 and L{yi, 2/2) = 2/1 implies 

=7l,M.(w) -^n([0,M])72,^„(M), 



where 



7i,M.W = r{u)E{dl<^,„{M{u),u)yexpW,„{u) 
+ C{uyE{dl^,„{M{u),u))'expW,M 



and 



12,,M = 2CiufE{dl^,^iMiu),u)fexpW,M- 
Since (X'f^Jn>i converges uniformly to ,^"(-)E(9^<l>^(M(-), ■))^ exp W^^(-) on [0, 1], it implies 



that = lim„_>oo is differentiable and its derivative is given by (20). Now, let < 
ui < U2 < I- Suppose that u'^ and U2 satisfy ui < u'^ < u'2 < U2. From the mean value 
theorem, we can write 



CK), (39) 



for some uq G {u[,U2)- Note that 

• Hn{[0,u[]) < /i„([0,M]) < /i„([0,M2]) for u E [^1,^2]. 

• lim„^oo/in([0,M'i]) = /i([0,M'J) and lim„^oo /^n([0, Ug]) = fi{[0,u'2]). 

• 7i,^ = lim„_^oo 7i,/i„ and 72,^ = lim„^oo72,M„ uniformly, by part (ii) of Propostion 1. 



They together with ( 39 ) imply 



T'Ju'2) - T'{u[) 

} } < max 7i,/.(m) -/x([0,Mi]) mm 72,^(m) 

U2 — uG[u\^,U2\ ne[Uj,?i2j 
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and 



u'o — u\ 



> mill 71,^ (m) 



i2 LLl 

Now letting u'^ J, ui and u'2 f ^2, we obtain 



^2 — Ui 



< max 7i,^(m) 
ue[wi,M2] 



/i([0,M2]) max 72,^ (m). 



/i([0,Mi]) min 72,^(m) 

ng[ui,?i2] 



and 



> mm 7i,m(m) -/i([0,M2)) max 72,m(m)- 



Since the distribution of yU is right continuous and 71,;^, 72,^ are continuous, (21) follows 



by applying ui = u and U2 = u + h with h I to these two inequahties. Also, letting 



Ui = u + h with /i 'I" and U2 = u gives (22). 



4 Proofs of Theorems [T], |2], |3| and |4| 

In this section we will prove our main theorems stated in Section [T] 



4.1 Proof of Theorem [1] 

Proof of Theorem\l\ We start by proving item (z). Suppose that qm '■= minsupp fip 7^ 0. 
Note that r^^(gm) = Qm from Theorem Isl Also since dx^^p{x, u) is an odd function in u 



by (14), this implies that ^p{x,Q) = and then r^p(O) = 0. Now since /i([0,u]) = 
for < u < Proposition |3] implies the differentiability of V'^^ on [0,^^) and moreover 
with the help of (16), 



KM) 



for < n < Qm- This means that from (16) and ( |l7| ), T'^^{u) < T'^^{qm) < 1 on [0, Qm)- So 
Tfj^p can have only one fixed point on [0, qm], which contradicts r^p(O) = 0, T^p{qm) = qm- 
This gives (i). 

Next let us turn to the proof of (u). Suppose that /ip((0, g]) > for some < g < g. 
Let us take q' e supp /ip fl (0,g]. Then T^p{q') = q' from Theorem [sj Note that from 
the discussion above, we also have r^p(O) = 0. Using the mean value theorem to T ^p and 



(16), we obtain a contradiction, 

^_ r^,(gO-r^,(o) 

g'-O 

for some q" G (0,g'). Hence, /ip((0,g]) 
gives (m). 



r;,(g")<e"(g")<e"(9) = i 

for all < g < g and this together with (z) 
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4.2 Proof of Theorem d 



Proof of Theorem^ We prove {%) first. Since (M/)f>i, (u7)^>i ^ supp /xp, we have by 
Theorem [sj T ^p{ul) = and r^p(ti^) = . The mean value theorem and (i) in 
Proposition [3] now ensures the existence of two sequences {ul)e.>i and {uj)i>i that satisfy 
■u^ 4, Mo, ^7 t ""o and r^^('u^) = 1 = V'^^iuJ). These together with (21) and (22) imply 
that 



7i,/.pK) - /Up([0,Mo))72,/.p(mo) 
7i,Mp("o) - Atp([0,Mo])72,/.p(Mo) 



/l-!>0+ 



lim 



r' K) 



0, 



where 7i,;xp and 72,/ip are defined as in Proposition |3| Since 72,^p(mo) 7^ from (16), it 
follows that /ip([0,Mo]) = /ip([0,'Uo)) and so /ip is continuous at Uq. 

As for (ii), we denote by the distribution of /ip. Note that since (a, 6) C supp //p, 
(z) implies the continuity of x^p on (a, h) and thus the right continuity of x^p further 
gives the continuity of x^p on [a, h). We claim that x^p is infinitely differentiable on [a, 6) 
by induction. Since (a, 6) C supp /ip. Theorem |5] and continuity of F^^ yield V fj_p{u) = u 

on [a, h). Conse- 



on [a, 6). Therefore, continuity of /ip Proposition |3| implies P'^ 
quently, it gives us x^p{u)'^2,tJLp\ 
[0, 1]. We may now write 



[u] 



u 



71, 



MP 



on [a, 6). Note again that 72, 



MP 



u 



X 



{u) 



au)F,{u) + F2iu) 



^ on 



(40) 



where 



Edl<!>^p {M{u) , m)' exp W^p {u) 
¥.{dl^^p{M{u),ufe^^W^ 



.u 



F,{u) 
F2{u) 
Fsiu) 

Now since /ip is continuous on [a, 6), Lemma |2| implies that ^1,^2,^3 are differentiable 
on [a, b). We then conclude that is differentiable on [a, h). Suppose that xj^l exists on 
[a, h). Observe that from ([40|, one can easily derive by differentiating Fi for j < n times. 



2E(a^$^^ (M(n) ,u) f exp W^p (u) . 



F,^'Uu) 



MP' • 



I'-'x ^ lipi t^pi flpl • • • 1 lip 



where i^jj's are polynomials of 3j + 4 variables. Applying (38) again and using the 
induction hypothesis 
completes our proof. 



induction hypothesis that x']^p exists, it follows that exists and the quotient rule 



4.3 Proof of Theorem [3] 

We will prove Theorem [3] by contradiction. Before we turn to the main proof, let us make 
a few observations on Parisi measures. Denote by Zjv,t the partition function associated 
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to the Hamiltonian tHiv for t > 0, that is 



ZN,t = y^exptij"Ar(cr). 

Denote by (■) the expectation with respect to the Gibbs measure Gn corresponding to 
the Hamiltonian in Section [Tj A direct differentiation yields 



d 1 

dtN 



E log ZN,t 



t=i 



{H^ia)) < ^EmaxH^icr) < ^2^(1) log 2. (41) 

iV iV <T 



Here the last inequality in (41 ) relies on a standard Gaussian inequality that E maxj<Af gi < 



r\/2 logM for arbitrary centered Gaussian process {gi)i<M with Egf < for i < M. Now, 
the Gaussian integration by parts applied to E {Hj\f{(T)) implies that 



N 



E(i7^(o-)) =E(e(l)-e(^('T\o-^ 



and from (41 ) 



\ m I 



> 1 



/21og2 

W 



(42) 



It is well-known [HI |T7] that the moments of a Parisi measure contain information of the 
limit of the overlap under E (■) through 

J 

for all p > 2 with /3p 7^ 0. This and (|42|) imply that 



> 1 



'21og2 
W 



(43) 



Now suppose on the contrary that /ip is either RS or IRSB. If /ip is RS, part [i) in 
Theorem [1] implies that /ip = 5o- However, this contradicts (43) since the left side of (43) 
is equal to zero, while the right side of the same equation is positive by (|4]). Now suppose 
that /ip is IRSB, that is, /ip consists of exactly two atoms. Again by part ii) of Theorem 
[H w e may assume that /ip = m^o + (1 " '^)^g for some < m, g < 1. Plugging /ip into 
(43) gives 



m) > 1 — 



'2 log 2 
W 



Observe that the left side of this inequality is bounded above by 1 — m and since u$,'{u) > 
^{u) for all u > 0, it is also bounded above by ^'(^)/^(l)- We conclude that m and q must 
satisfy the following two inequalities. 



m < 



'2 log 2 



(44) 
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and 



e{q) > e(l) (^1 - ^/^) = ^(1) - Vnmog2. 



(45) 



Proof of Theorem\^ Note that /ip corresponds to m = (0, m, 1) and q = (0,0,g, 1) as 
described in Section |2} Let Zq, Zi, Z2 be independent centered Gaussian random variables 
with Ez^ = 0, Ezf = f (g) and Ez^ = ^'(1) - ^'(g). Then using Q, 

X3 = logcosh(zo + zi + Z2) = logcosh(zi + Z2), 



X2 = logcosh^i + -(e'(l)-r(g)), 



— Xq 



1 



log E exp 171X2 



ilogEcosh'^zi + 
m 2 



Plugging Xi and X2 into the definition (18) of T^p and using Proposition [3] we obtain 

,expm(X2-Xi) ^„_,Ecosh'^-^ 



cosh Zi 



Zl 



Ecosh™ zi 



Let us recall two useful facts about a Gaussian random variable, 



and 



Ee^l^l = 2e'^(/)(a), Va G 



32 \ 

< e'^Ma) < — , Va < -2, 



4|a| 



(46) 



(47) 



(4J 



where 0(a) = J^^e~^ /\/2ndx for a G M. Note that since < m < 1 and .^(1) > 8 log 2, 
it follows from (45) that (4 — rh)y^^'{q) > 2. Also note that coshx < e'^L Now using (47) 
and (48) with a = — (4 — 'rh)^^S,'{q) we obtain 

E cosh'^"^ -21 > E exp(m - 4) |zi | 

= 2$ ((m - 4) exp ^(m - 4)2^'(g) 

1 



> 



> 



2(4-m)v/e(^ 
3 



On the other hand, (47) with a = rh\/i'{<i) gives 

E cosh'" 2:1 < Eexpm|zi| 



2$ (myeM)exp^r(g) 



<2exp — r(g) 



m 



<2exp ^r(l)- 
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From these two inequalities and ( 46 ) , we have 

.„,.,Ecosh'^-^2i 



3 C{q) 
16vHl)expfe'(l) 



<e{q)- 



Ecosh™ zi 



(49) 



Next, note that > f (m) and - V2 log 2 > ^/^/2 since we assumed in Q 

that ^(1) > 8 log 2. From @, 



From (44), 



2f(l)log2 



Combining (50), (51) and using Theorem |5| we conclude from (49) that 
3 ^(1) 3 



2 



22 V^2W 16 ^/^exp (|glog2 
However, this contradicts the assumption ^ on ^. 



<r' (g)<l. 



(50) 



(51) 



4.4 Proof of Theorem [4] 

Proof of Theorem^ If gM is an isolated point of supp /ip, it must be a jump discontinuity 
oi lip and this clearly implies our assertion. Assume that qu is not isolated and /xp is 
continuous at this point. Theorem [5| the mean value theorem to F^^ and continuity of 
imply 

C{qM)ndl^^^p{M{qM),qM)f e^W^M = T'{qM) = 1 (52) 



and in addition from (21) and (22), 



7i,Mp(9Af) - 72,mp(9m) = 7i,mp(9m) - /ip([0, qM])l2,t,p{qM) = r)'^(gM) = 0. (53) 

Observe that $^p(x,gM) = logcosha; + (^'(l) — ^'(gM))/2. A straightforward computation 
yields 



dl^^p{x,qM] 



{dl<^^^{x,qM)f 



cosh^ X ' 
4 



cosh X cosh X 



Thus, we obtain from (52), 



E 



expW^p{qM) _ 1 
cosh^ M(gM) ~ ^"{Qm) 



(54) 
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Also since 



+ 4e"(gM)ME 



exp W^Qm) 
M( 

exp Wf,p {qm) _ ^exp Wf,p [qu] 



cosh^ M(gM) cosh^M(g 



M) 



and 



^2^ expW^^(gM) 



72,Mp(9M) = 2r(gM)'E- 



they imply from (53) that 

,expiy^^(gM) 



E 



cosh^ M{qM) 



^'"(^^^) expl^^,(gM) 



6e(gM)2 3; cosh^M(g 



/A/ J 



(55) 



Note that EexpVF"^p(gM) = 1 from (17). Using Jensen's inequality together with (54) 
and (55) gives 



E 



expl4^^^(g_ 



M 



M / 



cosh^M(gAf) 



< E 



,eyiY>Wf,p{qM, 



cosh^ M{qM] 



2/3 



2/3 



One may simplify this inequality to get equivalently 



(56) 



Now since ^(1) > i"{qM) > 2/3| > 1 and f"(l) > C'(gA/), (56) yields 



r(l) 2^^ 
6 ^ 3V'' V J 



which contradicts the assumption ([6]). This finishes our proof. 



5 The spherical case 

We now discuss the analogue of our results to the spherical mixed p-spin model. In this 
section, we set the configuration space to be 




On the sphere we consider the same Hamiltonian if at as in ([2]). The spherical mixed 
p-spin was introduced by Crisanti-Sommers |5] as a possible simplification of the mixed 
p-spin model in the hypercube S^y. The main difference from the model with Ising spin 
configurations is that the analogous Parisi functional has a much simpler formula. This 
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formula was discovered by Crisanti-Sommers 0] and proved by Talagrand [18] and Chen 
[2j. We describe it now. As before, given a probability measure fi on [0, 1], consider its 
distribution function = /i([0,g]). For q e [0, 1], let 



x^{q) = / Xf,{s)ds. 



g 



Assuming that x^{q) = 1 for some q < 1, define 



V'ifi) = \{ f x,iq)C{q)dq + log(l - q) 



\ Jo 



Otherwise, set V^^n) = oo. 

A measure that minimizes V"^ is called a Parisi measure for the spherical mixed p-spin 
model. The above formula provides two major simplifications compared to First, it is 
known that, for all choices of ^, Parisi measures are unique [HI Theorem 1.2]. Second, in 
the pure p-spin model (^(x) = P^x^), there exists a /3p^c > such that the Parisi measure 
is RS below /3p^c and IRSB for all values of [5p > (3p^c [IS, Proposition 2.2]. However, for 
the mixed p-spin model, the structure of the Parisi measure is still not known and it is 
expected [3] that the model is FRSB for a certain class of mixtures ^. 

We now describe our results for the spherical mixed p-spin model. Recall that ^{u) = 
J2p>2 Pp'^^ assume that x^{q) = 1 for some q < 1. Define for < g < g. 



Note that Sq depends on the distribution function x^. It is known however that there 
exists qi < I depending only on ^ such that supp /ip C [0, qi] (see discussion on page 6 of 
[18]). We will denote this qi by qi{C,) and define S = The following characterization 

of the Parisi measure was proved in Talagrand [T8l Proposition 2.1]. It mainly relies on 
the Crisanti-Sommers formula. 

Proposition 4. fip is a Parisi measure if and only if fip{S) = 1. 

Using this proposition, we have the following result. 
Theorem 6. Let fip be a Parisi measure. Then the following hold, 
(i) supp /Up C 5. 

(ii) If (a, b) C supp fip with < a < b < 1, then 



fip{[0,u]) = 




for every u G (a, 6). Therefore, the distribution of fip is C°° on {a,b). 




(57) 



and let 



S<j:= {se[0,q]\fis) 
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[Ill] 



If h 7^ l/"\/2 and e supp jip, then there exists g > such that yUp([0,g]) 

Mm- 



(iv) Suppose that there exist an increasing sequence {u~[)i>i and a decreasing sequence 
{u'^)e>i of supp fip such that lim£_i.oo uj = uq = lim£_i.oo Then fip is continuous 
at uq. 

Proof. Take x G supp fip and define M = max^gp^gj f{t). We claim that there exists a 
sequence of points (x„)„>i C 5* such that {xn)n>i converges to x. We argue by contra- 
diction. If our claim does not hold, there exists an open neighborhood of x such that 
Ox n S = (/). However, since x G supp /ip, fip^O^) > and this contradicts Proposition 
|4j Now, since f{xn) = M and / is continuous on [0, 1), we get f(x) = M and therefore 
X E S. This proves (i). 

Next, suppose (a, 6) C supp /ip. From item (i), we have (a, 6) C S. From (57), we see 
that / is twice differentiable on (0, 1) with 

/(O) = 0, /'(g) = F{q) and f"{q) = ^(g) 



x(g)2 

Hence, any u E {a,b) C S satisfies f'{u) = and consequently, 

Ciu)'"^ =x^{u). (58) 

Since C,"{u) is positive and differentiable for any u E (a, 6), a straightforward computation 
implies that the right derivative of x^{u) is equal to —fip{[0, u]) and the left derivative is 
equal to —fip{[0,u)). By (58), we obtain that fip{[0,u]) = fip{[0,u)) which means fip is 
continuous on (a, 6). Again from (58) and the fundamental theorem of calculus, we have 



/ip([0,M]) = -X Ju) 



This proves (u). 

Now suppose G supp fip and the existence of a sequence m„ J, such that m„ G 
supp fip. Then by part (i) and the mean value theorem, there exists a sequence m'„ I 
such that f"{un) = 0. By the continuity of /" at 0, we have /"(O) = 0. This immediately 
implies that 2/3| = ^"(0) = 1 giving item {Hi). 

Next, to see that (iv) holds, one argues similarly. The two sequences in S converging 
to Mo imply 

. fjuQ + h)- r (no) /ip([0,%]) 

U = hm = E (Uq) ; — 

h^0+ h ^ ^ ^' 2x^^(uo)3' 



r (% + h)- r (no) , /ip([0,%)) 

hm = E (Uq) ; ^ 



3 



This gives us /ip([0,Mo)) = Atp([0,Mo])- 



□ 
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Example 4 ((2 +p)-spin spherical model). Consider the case 



for t G (0, 1) and p > 4. We claim that if 



< /-^ ^ , ^ and > — r, (59) 



1-t - (p- l)p2 2(1 -t)' 

then the model is FRSB with a jump at the top of the support. Furthermore, the Parisi 
measure /ip is given by 

, for U < Qiyf, 

2?"H^ ^ ' (60) 

1, for u > Qm, 

for some qm G (0, 1). 

We use Proposition |4] to prove this claim. Indeed, it suffices to check that fXp{S) = 1. 
Let 0(u) = ^"{u)^^^'^. Condition (59) implies that (p is concave, 0(0) < 1 and 0(1) > 0. 



Therefore, the graph of on [0, 1] intersects the line y = 1 — x at a single point qm < 1- 
Since 0(g) > 1 — g for g > qm, we have ^"(g) < 1/(1 — g)^ for g > qm- This implies that 



F{q) < for g > qm- Now, (60) implies /(g) = for g < qm and /(g) < for g > qm- 
Thus, S = [0, g^f] and fip{S) = 1. A non-rigorous discussion of this model can be found 
in[3]. 



Appendix 

This appendix is devoted to proving Proposition [l] Let fi G M[0, 1]. Recall the definition 
of Wn from (13). It can also be written as 



W^{u)= [ <^^{M{u),u)-<^^{M{tAu),tAu)dfi{t). (61) 
Jo 

Define for x G M and u G [0, 1], 

Vf,{x,u)=[ <l>^{x + M{l)-M{u),l)-<l>^{x + M{uVt)-M{u),uVt)dfi{t). (62) 
Jo 

As we have already mentioned in Section [2| $^ is a continuous function on M x [0, 1]. 
This implies that the preceding random functions are almost surely continuous. Define 
Fi{w) = w and for j > 1, 

i-i 

Fj+i{yi ...,yj,w) = y] dy^Fjivi, yj^i, w)yi+i 

tr (63) 

+ d^Fj{yi, ...,yj_i,w){l-w^) + Fj{yi,..., yj_i,w)yi. 

Let us start by summarizing some regularity properties of Parisi PDE solution when the 
measure consists of a finite number of atoms. 
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Proposition 5. Suppose that n G Md[0, 1] consists of a finite number of atoms on {qp)pt^l 
with yu([0, gp]) = rrip for 1 < p < k + 1. Then the following statements hold. 



{i) For J > 0, 



In particular, for j > 1, 



di^^ECiRx[0,l]), Vj>0. 



u 



and 



tanh(a; + M(l) - M{u))) exp V^{x, u) 



sup |(9;J.$^| < Co,j. 

Rx[0,l] 



(64) 



(65) 



(66) 



(ii) We also have 



For j > 0, 



(67) 



max{ max sup |<9„(9^$^|Rx[gp_i,qp) | , sup \dudl<^^\Ky,ig ^\} < Cij. 



(6^ 



Here Cij 's depend only on ^. 



Proof. First let us prove (65) and (66) simultaneously by induction. The base case j 



relies on Lemmas 3.3 and 3.4 in [17J which state respectively that (65) holds for j = 1 and 



that Eexp V"^ = 1. These and | tanh | < 1 imply (66) with j = 1 and Co,i = 1. Suppose 



that there exists some j > 1 such that (65) and (66) hold for all 1 < j' < j. Note that 
tanh' = 1 — tanh^ . From these, a direct differentiation leads to 

di^'^,{x,u) = EF,+,id,V,ix,u), . . .,diV,{x,u), 

tanh{x + M(l) - M(u))) exp Vf,{x, u). 

Now observe that since -Fj+i is a polynomial and EexpV^ = 1, they together with the 
induction hypothesis give (66) when j is replaced by j + 1. This completes the proofs for 



(65) and (66). Also an induction argument by using the definition (62) of Vn and (65) 



yield (64). This gives (i) 



Next let us prove (ii). Recall that can be solved by (11) and (12). By an induction 



argument using Gaussian integration by parts, (67) follows immediately. As for (68), note 



that satisfies 



((9^$^(x, u) + mp_i(9^$^(x, u)y) 
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whenever (x, u) G Mx [qp-i, Qp) for < p < k + 1 and {x, u) G Mx [qt+i, !]• The inequahties 
(66) together with an apphcation of the product rule imply 

max{ max sup sup |c)„c)^.$^|} 

Rx[gfc+i,l] 



< 



-l<P<fc+llR>x[gp_l,5j,) 



0,j+2 + X] ( ) Coj'+lCo,j-j'+l 
j'=0 ^-^ 



This finishes our proof. 



Lemma 3. There exists a constant C depending only on ^ such that for any fi G M[0, 1], 

(69) 
(70) 



sup E exp 3V^ < C, 

Rx[0,l] 



supEexpSVT^ < C. 

[0,1] 



Proof. Since the arguments for both (69) and (70) are the same, we will only provide the 
detailed proof for (70). First we claim that it holds when fj, G Md[0, 1]. Observe that for 
t > u, 

$^(M(m), m) - $^(M(t Au),tAu) = 

and for t < u, we may write 

$^(M(m), m) - $^(M(t A m), t A m) 
= $^(M(m), u) - <l>^(M(u), t A u) 
+ (^f,{M{u),t Am) - ^f,iM{t Au),tAu) 



and apply the mean value theorem, (66) and (68) to get 



\^^{M{u),u) -<^^{M{tAu),tAu)\ < C{\M{u) - M{tAu)\ + \u-tAu\). 



Thus, 



\W^{u)\<C {mp-mp_i){\M{u)-M{qpAu)\ + \u-tAu\) 

k+1 

< C^(mp-mp_i)(|M(M) -M(gpAM)| + 1). 
p=i 

Note that for 1 < p < A; + 1, 

9C^ 9C^ 
Eexp ±3CiM{u) - M{qp A u)) = exp—\^'{u) - i\qp Au)\< exp ^^'(1)- 
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Since X]p=i("^p ~ f^p-i) — 1, using Holder's inequality and the inequality e'^' < + e ^ 
for all y e M imply 

k+l 

Eexp3W^{u) < exp3C JJ(Eexp3C|M(M) - M(gp A 



p=i 
fe+i 



nf<2 

<exp3Cn(2exp— 

p=i ^ 

= 2exp 3C+^e'(l) 



For general n, we approximate /i by a sequence of probability measures (yU„)„>i C M[0, 1]. 
Since $^(M(-u),'u) — <l>^(M(t A A m) is a continuous function in t G [0, 1], the weak 
convergence of {Hn)n>i implies lim^^oo W^^ = a.s. and the Fatou lemma concludes 
our assertion. 



Next, we will need a basic lemma in probability theory. 

Lemma 4. Assume that {fin)n>i C M[0, 1] converges weakly to fi. For n > 1, suppose 
that Tn is a collection of continuous functions on [0, 1] such that sup f^^jr^ \\h\\oo < M and 
there are e,5 > such that sup^^g^^ \h{w) — h{w')\ < e whenever \w — w'\ < 5. Then 



limsup sup 

n— >-oo h&Fji 



hd^r, 



hdn 



< 2s. 



Proof. Let F„ and F be the distribution functions of and respectively. Let us 
partition [0,1] by intervals Ji = [0,ai],/2 = (ai, 02], • • • , -^fc = (afc-i,afc] with < 5 for 
j = l,2...,k. These Ij may be chosen so that they are intervals of continuity of F. 
Since each h G J-'n satisfies sup^y^,^j_. \h{w) — h{w')\ < e, we can approximate /i by a step 
function g assuming constant value in each Ij and such that \h{w) — g{w)\ < e for all 
w e [0,1]. Then 



{h - g)dii 



{h - g)dnn 



< £, Vn > 1 . 



Since Fn{aj) F{aj) for each j — 1,2, . . . , k — 1 and -Fn(l) = 1 ^ F{1) — 1, we have 
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that for sufficiently large n, 



hd{fi — fi„ 



< 



< 2e 



{h - g)dfi 



+ 



gd{fi - fir, 



{g - h)dfir, 



gd{fi - fi„ 





fc-i 



<2e + Y, \g{a^+i)\ |(F„(a,+i) - F„(a,)) - (F(a,+i) - F{a,))\ 



j=0 



k-l 



< 2e + (|F„(a,+i) - F(a,+i)| + |F„(a,-) - F(a,-)|) • 

j=0 

Since this holds for any h G J-'n, letting n — )■ oo gives our assertion. 



Using the preceding lemma, we have the following: 
Lemma 5. Suppose (/in)n>i C Md[0, 1] converges weakly to fi. 

(i) If {di^^,Jn>i converges to d^^^ uniformly on M x [0, 1] for j > 0, then 

hm sup E\diV,^-diV,\' = 0. 

n^oo giRx[0,l] 



(71) 



{ii) We have 



lim supE\W^^-W^\ 

[0,1] 



(72) 



Proof. Again, since crucial arguments for both (71) and l\72« are essentially the same, we 



will only prove (72). For / G C[0, 1] and {x,u) G M x [0, 1], we define 



Ai'^it) = $^„(/(w), w) - $^„(/(t Au),tA u), \fn > 1, 
A^'"(t) = <^,ifiu),u) - <l>^(/(t Au),tAu). 



For e > and /o G C[0, 1], set an open ball 

B{fo,e) = {feC[0,l]:\\f-fo\\^<e} 

and for n > 1, 

Tnifo) = {A^'" : n G [0, 1], / G Bifo,e)} C C[0, 1]. 
For arbitrary < t,t' < 1, write 

A{-"(t) - A{--(t') = $^„(/(t A «), t A w) - <l>^„(/(t' Au),t'Au) 
= $^„(/(t A n), t A n) - <l>^„(/(t Au),t'Au) 
+ <l>^„(/(t A M),t' A n) - $^„(/(t' A u),t' A u). 
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Using (66) and ([68]), the mean value theorem imphes 

- A{'^(t')| <Ci\tAu-t' Au\ + \fitAu)- fit' Au)\). 
This imphes two immediate consequences. First there exists some 6 > such that 

sup \h{t) - h{t')\ < Ce 

whenever |t — t'| < S. Second, since h{u) = for aU h E -7^o(/o), 

sup \\h\\oo < oo. 



(73) 



(74) 



From (73) and (74), applying Lemma |4] to Tn{fo) yields 

•1 



limsup sup 



hd{nn - /i) 



< 2C6. 



(75) 



Next using the tightness of the time changed Brownain motion {M{u))q<u<i, there 
exists a compact set /C C C([0, 1]) such that P(/C'^) < e. Let us cover /C by a finite number 
of open balls B{fj, e) for j = 1, 2, . . . , Write 



1 



(A*^'"(t) - <'«(t)) rf/i(t) + / <'"(t)rf(/i-/i„)(t). 



(76) 



Recall that as we have mentioned before, ($n)n>i converges to $ uniformly on M x [0, 1]. 
It follows that 



sup ||A^'^-A{'"|U<e 
/ec[0,i] 



(77) 



for sufficiently large n. From (76) and (^77|, it follows that 



sv.v^{\W,{u)-W,M?--^) 

[0,1] 

<2V + 23supVE( ! Af'"rf(/i-/i„ 

[0,1] 



:5(/,,£)n/C 



< 2^e^ + 2^ V sup 



/l(i(yU — jln) 



p(i?(/,,£)n/C) 



and then from ( 75 ) 



limsupsupE (|W^(m) - W^„(n)p : K) < 2V + 2''CV V P(5(/i, e) n /C) 

?i-5>oo [0,1] 



i=l 



= + 2^C^e^¥{K:) 
< (2^ + 2^^2)62. 



(7J 
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On the other hand, using Lemma |5] again, we have 



supE {\W^{u) - W^Mf : /C^) < CP(/C^) < Ce. 

[0,1] 



This together with ( 78 ) completes our proof. 



Lemma 6. Let (/U„)„>i C M(;[0,1] converge weakly to fi. For j > 1, let 

Q{y) = P{yi,-- • ,l/i)exp?/o 

for y = {yo,yi, ■ ■ ■ ,yj) ^ M-^^^ where P is a polynomial. Suppose that 9^'$^ exists and 
hm„_>.oo dl = di $^ uniformly on M x [0, 1] for < j' < j. Then 

hm sup E\QiV,„,d,V,„,...,diV,„)-Q{V„d,V„...,diV,)\=0 (79) 

'^^«=Rx[0,l] 



and 



hm supE|Q(W^^„, W'^^, ...,Wp- Q{W,, ....Wj,)\ = 0, 

[0,1] 

where for any v e M[0, 1], := dx^({M{u),u) for < u < 1 and I < j' < j. 



Proof. Once again we will only provide the detailed proof for (80). As for (79), it can 
be treated by a similar argument as (79). Let Co,i, . . . , Cqj be the bounds we obtained 
from (66). Using the mean value theorem, there exists some constant C depending only 
on Co,i, . . . , Cqj such that 

IQ(y) - Q(y )l = |vg(ty + (i - t)y') ■ (y - y')l 

< ||vg(ty + (l-t)yO||||y-y1| 
<Cexp{\tyo + {l-t)y',\)\\y-y'\\ 

j 

< Cexp{\yo\ + |?/d|) \yi - yl\ 

i=0 

whenever y,y' satisfy \yi\, \yl\ < Co^i for 1 < i < j. From this and Holder's inequality, it 
suffices to prove that for some C > 0, 



and 



max{ sup Eexp 3|iy^„ I, supEexp3|iy^| } <C 

[0,1] [0,1] 



lim supE|PV^„-iy^|=^ = 0, 

n->oo jo^y 

lim supE|Vr^ - Wi\^ = 0, l<i<j. 



[0,1] 



(81) 

(82) 
(83) 



Here (81) and (82) follow respectively from (70) and (72), while (83) holds directly from 
the uniform convergence of (5*$^^)„>i. This completes our proof. 
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Proof of Proposition^^ Note that since Md[0, 1] is a dense subset of M[0, 1], it suffices to 
consider (/i„)„>i C Mrf[0, 1] with a weak hmit /i. First, let us prove (z) by induction. The 
base case follows by the Lipschitz property of the functional $. as discussed in Section 
|2] Suppose that there exists some j > such that the announced result holds for each 
< j' < j. Recall -Fj+i from (63). Observe that it can be written as 



Fj+i{yi, ■ ■ • = ^Pi{yi, ■ ■ -^ViW, (84) 



i=0 



where Pq, • • • , -P^ are polynomials and £ > 1. Set Qiiyo, yi, ■ ■ ■ , yj) = Pi{yi, ■ ■■ , yj) expyo- 



for all < j' < j, applying ( 79 ) and | tanh | < 1 we obtain 



Since ^^^^ is continuous from (64) and lim„_>oo = dl $^ uniformly on M x [0, 1] 



limsup sup E\Qi{Vf,„{x,u),d^V^^{x,u),. . . ,diVf,^{x,u)) 

n^oo Rx[0,l] 

- Qi{V^{x, u), d^V^ix, u),..., diV^ix, u))\ I tanh^(x + M(l) - M{u))\ = 0. 



From (84), this and (65) imply that {di'^^^f^^}n>i converges uniformly on M x [0, 1]. So 
dl'^^^^ = lim„_j.oo di'^^^^,^ exists and is continuous. This gives (i). 

Next let us turn to the proofs of (ii) and (Hi). Define Q(y) = P{yi, • • • , yj) exp yo for 
y = {yo,yi, ■ ■ ■ ,yj)- From part (i), we know that {d^ ^fi„)n>i converges uniformly to $^ 



on M X [0, 1] for all < j' < j. Consequently, (u) follows from (80). As for {Hi), it can be 



simply concluded from (i) and the definition of the Parisi PDE (10) 
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